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O ■ Abstract 

£>y In this paper, we study capacity bounds for discrete memoryless broadcast channels with confidential 

messages. Two private messages as well as a common message are transmitted; the common message is 
to be decoded by both receivers, while each private message is only for its intended receiver. In addition, 
each private message is to be kept secret from the unintended receiver where secrecy is measured by 
equivocation. We propose both inner and outer bounds to the rate equivocation region for broadcast 
channels with confidential messages. The proposed inner bound generalizes Csiszai and Korner's rate 
equivocation region for broadcast channels with a single confidential message, Liu et al's achievable rate 
region for broadcast channels with perfect secrecy, Marton's and Gel'fand and Pinsker's achievable rate 
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region for general broadcast channels. Our proposed outer bounds, together with the inner bound, helps 
establish the rate equivocation region of several classes of discrete memoryless broadcast channels with 



confidential messages, including less noisy, deterministic, and semi-deterministic channels. Furthermore, 
, specializing to the general broadcast channel by removing the confidentiality constraint, our proposed 

outer bounds reduce to new capacity outer bounds for the discrete memory broadcast channel. 

in 
o 

(V") 

I. Introduction 

With the increasingly widespread wireless devices and services, the demand for reliable and secure 
^ ■ communications is becoming more urgent due to the broadcast nature of wireless communication. Existing 

systems typically rely on key-based encryption schemes: the intended transceiver pair share a private 
key which is unknown to any unintended users. Assuming ideal transmission of encrypted messages, 
Shannon in his 1949 landmark paper [1] proved, using information theoretic argument, a surprising 
result: security is guaranteed only if the key size is at least as long as the source message. While this 
establishes provable security of the so-called one-time pad system, the excessive requirement on the 
key size essentially forebodes a negative result: any key-based encryption scheme is almost always not 
provably secure as the key size requirement forbids dynamic key exchange. This result motivates many 
secure communication scheme where provable security is sacrificed in favor of computational security; 
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however, this notion of security relies on unproven intractability hypotheses. For instance, the security 
of RSA [2] is based on the unproven difficulty of factoring large integers. 

Wyner in his seminal work in 1975 [3] demonstrated that, for noisy channels, provable secure commu- 
nication (in the same sense as that of Shannon) can be achieved by exploring information theoretic limits 
at the physical layer. Wyner introduced the so-called wiretap channel which is in essence a degraded 
broadcast channel and characterized its capacity-secrecy tradeoff. It was shown that, through the use of 
stochastic encoding, perfect secrecy is possible in the absence of a secret key. Later, Csiszar and Korner 
generalized Wyner's result [4] by considering a non-degraded discrete memoryless broadcast channel 
(DMBC) with a single confidential message for one of the users and a common message for both 
users. Following the approach of [3] and [4], information-theoretic limits of secret communications for 
several different wireless networks have been investigated, including multi-user systems with confidential 
messages [5]— [12], secret communication over fading channels [13], [14] and MIMO wiretap channels 
[15]-[17]. 

In this work, we generalize Csiszar and Korner's model by considering discrete memoryless broadcast 
channels where both receivers have their own private messages as well as a common message to decode. 
We refer to this model as simply DMBC with two confidential messages (DMBC-2CM). The DMBC- 
2CM model was first studied by Liu, Marie, Spasojevic, and Yates [9], [18] where, in the absence of 
a common message, the authors imposed the perfect secrecy constraint and obtained inner and outer 
bounds for the perfect secrecy capacity region. 

In this paper, we study capacity bounds to the rate equivocation region for the general DMBC-2CM. Our 
model generalizes that of [18] by including a common message. More importantly, we do not impose the 
perfect secrecy constraint and study instead the general trade-off among rates for reliable communication 
and secrecy for confidential messages. Study of this general model allows us to unify many existing 
results. Both inner and outer bounds are proposed for the general DMBC-2CM. The proposed achievable 
rate region generalizes Csiszar and Korner's capacity rate region in [4] where only a single confidential 
message is to be communicated, Liu et a/'s achievable rate region under perfect secrecy constraint [18], 
and Marton and Gel'fand-Pinsker's achievable rate region for general broadcast channels [19], [20]. The 
proposed outer bounds to the rate equivocation region of a DMBC-2CM also encompass existing outer 
bounds for various special cases of the DMBC-2CM. In particular, it reduces to Csiszar and Korner's 
rate equivocation region for DMBC with only one confidential message and Liu et la's outer bound to 
the capacity region with perfect secrecy. The proposed inner and outer bounds coincide with each other 
for the less noisy, deterministic, and semi-deterministic DMBC-2CM, which settle the rate equivocation 
region for these channels. Furthermore, in the absence of secrecy constraints, our proposed outer bounds 
specialize to new outer bounds to the capacity region of the general DMBC. Comparison with existing 
outer bounds in [19], [21]-[23] will be discussed. 

The rest of the paper is organized as follows. In Section II, we give the channel model and review 
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relevant existing results. In Section III, we present an achievable rate equivocation region for our channel 
model and show that it coincides with various existing results under respective conditions. In section 
IV, we present outer bounds to the rate equivocation region of DMBC-2CM. We prove that the outer 
bound is tight for the less noisy, deterministic, and semi-deterministic DMBC-2CM. We also discuss the 
induced outer bound to the general DMBC and its subset relations with existing capacity outer bounds. 
Finally, we conclude in Section V. 

II. Problem Formulation and Previous Results 

A. Problem Statement 

A discrete memoryless broadcast channel with confidential messages AC is a quadruple (<-f ,p, J^i, 3^2)5 
where X is the finite input alphabet set, J^i and 3^2 are two finite output alphabet sets, and p is the 
channel transition probability p(y±, y2\x). We assume that the channels are memoryless, i.e., 

n 

p(yi,y2|x) = Y[p(yu,y2i\xi) (l) 

i=i 

where, 

x = (xi, • • -, x n ) € X n , (2) 

yi = (yn,--;ym) e 3T (3) 

y2 = (2/21," ■ -,2/2n) G ^2 (4) 

Let Mo = {1, 2, • ■ M } be the common message set, Mi = {1, 2, • • •, Mi} and M2 = {1, 2, • ■ •, M 2 } 
be user 1 and user 2's private message sets, and Wo,W\,W2 are the respective message variables on 
the sets Mo,Mi,M2- We assume stochastic encoding as randomization may increase secrecy [4]. A 
stochastic encoder / with block length n for K, is specified by /(x|w;i, W2, wo), where x G X n , w\ € M\, 
W2 € M2, wq G Mo and 

^2f(x\w 1 ,w 2 ,w ) = l. (5) 

x 

Here /(x|u;i, w 2 , wo) is the probability that the message triple (w\,W2,wo) is encoded as the channel 
input x. Our model involves two decoders, i.e., a pair of mappings 

<Pi : y'i Mix Mo, 
V2- y'2 M 2 x Mo- 
The average probabilities of decoding error of this channel are defined as 

P S = M m M 2 PiiMyi) ^ (wi,w )}\{w u w2,w ) sent), (6) 

120 Wi,W 2 ,W 

P eH = MM M S p (i^(y2) + (u>2,«>o)}|(u;i,u;2,u>o) sent )- ( 7 ) 

Wi,W 2 ,W 
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A rate quintuple (Ri, R 2 , Ro, R e i, R e 2) is said to be achievable if there exist message sets M.\, M. 2 , 
M.q and encoder-decoders (/, cpi, ip 2 ) such that P™ t — > and P™ 2 — * 0> where for a = 0, 1, 2 



lim - log 1 1 A1 a 1 1 = Ra 

n— >oo n 

lim -H(W 1 \Y 2 ) > Rei 



lim -H(W 2 \Y 1 ) 

n— >oo fi 



R, 



c2 



(8) 
(9) 
(10) 



The rate equivocation region of the DMBC-2CM is the closure of union of all achievable rate quintuples 
(i?0) Ri,R2, Rei,Re2)- Our objective in this paper is to obtain meaningful bounds to the rate equivocation 
region for DMBC-2CM. 

The DMBC-2CM model is illustrated in Fig. [TJ We note that in the absence of W2, the model reduces 
to Csiszar and Korner's model with only one confidential message [4]. On the other hand, in the absence 
of confidentiality constraints (i.e., H(W\ IY2) and if (W^Yi)), our model reduces to the classical DMBC 
with two private messages and one common message. 



W 
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w 2 
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Decoder 1 

fx 



Channel 2 
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Decoder 2 
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(W U W ) 



H(W 2 \ yi ) 
(W 2 ,W ) 



ff(Wi|y 2 ) 



Fig. 1. Broadcast channel with two confidential messages Wi, W% and one common message Wo 



Before proceeding, we introduce the following definitions. Let Z = (U, V\, V 2 , X, Y±, Y 2 ) be a set of 
random variables such that X € X, Y% G y±, Y 2 G 3^2> and the coiTesponding p(yi,y2\x) is the channel 
transition probability of the DMBC-2CM. Define 

• Qi to be the set of Z whose joint distribution factors as 

p(u, vi,v 2 ,x, yi,y 2 ) = p(u, v l ,v 2 )p{x\u, v 1 ,v 2 )p(yi,y 2 \x). 

Thus any Z G Qi satisfies the Markov chain condition UV\V 2 — > X — > Y{Y 2 . 

• Q2 to be the set of Z whose joint distribution factors as 

p(u, v 1 , v 2 , x, yi , y 2 ) = p(u)p(v\ , v 2 \u)p{x\v l , v 2 )p(yi ,y 2 \x); 

Thus any Z G Q 2 satisfies the Markov chain condition U — ► V\V 2 — > X — > Y\Y 2 . 

• Q3 to be the set of Z whose joint distribution factors as 

p(u, vt,v 2 ,x, yi,y 2 ) = p{v 1 )p{v 2 )p{u\vi,v 2 )p(x\u, vi,v 2 )p(yi,y 2 \x). 

Q3 results in the same Markov chain as Qi except that V\ and V 2 are independent of each other. 
Clearly, Q 2 C Qi and Q 3 Q Ql- 
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B. Related Work 

In the section, we review several existing results related to the present work. 

Csiszar and Ktirner characterized the rate equivocation region [4] for broadcast channel with a common 
message for both users and a single confidential message intended for one of the two users. Without loss 
of generality (WLOG), we assume W 2 is absent from our model. The result is summarized below. 

Proposition 1: [4, Theorem 1] The rate equivocation region TZck for a DMBC with one common 
message for both receivers and a single confidential message for the first receiver is a closed convex set 
consisting of those triples [R\, R e , Ro) for which there exist random variables U — ► V — ► X — > Y{Y 2 
such that 

< R e <Ri (11) 

Re < HViYlP) - I(V;Y 2 \U) (12) 

R1 + R0 < /(F;yi|C0+nim[I(I7;yi),J(i7;r 2 )] (13) 

R < min^Yx),/^;^)] (14) 
We note that the Markov chain condition in Proposition Q] can be relaxed, as stated below. 
Lemma 1: Define 1Z' CK to be the convex closure of rate triples (R x , R e , Rq) that satisfy ([TTT)-(fl4l 
where the random variables follow the Markov chain: UV — > X — > Y{Y 2 , then 

K-CK = K'ck (15) 
Proof: Kck Q K' CK follows trivially from the fact that U -> V -> X -> Y X Y 2 implies UV -> X -> 
Y X Y 2 . To prove C Kck, assume (Rx,R e , Ro) £ ft'^ for some X Y X Y 2 . Define U' = U 

and V' = J7V, one can verify easily that (R x , R e , R ) satisfies flD-CU for U' -* V -> X -» Yi^, 
i.e., (Ri, R e , Ro) G Kck- ■ 

Recently, Liu ef a/ proposed an inner bound and an outer bound to the capacity region for broadcast 
channels with perfect-secrecy constraint on the confidential messages [9], [18]. The model in [9], [18] is 
in essence a DMBC-2CM without the common message. In their model, each user has its own confidential 
message that is to be completely protected from the other user. The proposed achievable region and outer 
bound are given in Propositions [2] and [3l respectively. 

Proposition 2: [18, Theorem 4] Let TZlmsy-i denote the union of all (Ri,R 2 ) satisfying 

< Ri < I{Vr,Y x \U) - I{V X ;Y 2 \V 2 U) - I{V X ;V 2 \U) 

(16) 

< R 2 < I(V 2 ;Y 2 \U) - I^-Y^VxU) - I(V i; V 2 \U) 

over all random variables (U, V\, V 2 ,X, Y\, Y 2 ) G Q 2 . Any rate pair (R x , R 2 ) G TIlmsy-i is achievable 
for DMBC-2CM without common message and with perfect secrecy for the confidential messages, i.e., 
Ro = 0, R\ = R e i, and R 2 = R e2 . 
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Proposition 3: [18, Theorem 3] An outer bound to the capacity region for the DMBC-2CM with 
perfect secrecy constraint is the set of all (R\,R 2 ) satisfying 

< i?i < min[J(Vi;yi|l7) - I{V i; Y 2 \U), IiV^^U) - I{V i; Y 2 \V 2 U)} (17) 
< R 2 < mm[I(V 2 ;Y 2 \U) - /(y 2 ; y [[/), /(y 2 ; y>|VW) - I^-Y^U)}. (18) 

for some (U, V±, V 2 ,X, Yi, Y 2 ) € Q 2 . We denote by TZlmsy-o this outer bound. 

In the absence of secrecy constraint, the present model reduces to the DMBC first introduced by Cover 
[24]. The capacity region for a DMBC is only known for some special cases (see [25] and references 
therein). The best achievable region for general DMBC is given by Gel'fand and Pinsker in [20] which 
reduces to Marton's achievable region [19, Theorem 2] for DMBC in the absence of common message. 
Capacity region outer bounds include Korner and Marton's outer bound [19, Theorem 5], Liang and 
Kramer's outer bound [22], [26], Nair and El Gamal's outer bound [21], [27], and a recently proposed 
outer bound by Liang, Kramer and Shamai (Shitz) [23]. 

Marton in 1979 considered DMBC in the absence of common message and proposed the following 
achievable rate region [19]. 

Proposition 4: [19, Theorem 2] Let TZm be the union of non-negative rate pairs (Ri,R 2 ) satisfying 



Ri,R 2 > and 

Ri < HUVnYi) (19) 

R 2 < I(UV 2 ;Y 2 ) (20) 

R! + R 2 < mm{7(C/;y 1 ),/(C/;y 2 )} + 7(F 1 ;y 1 |C/)+J(F 2 ;F 2 |C/)-J(y 1 ;y 2 |C/) (21) 



for some (U, V±, V 2 , X, Y±, Y 2 ) € Q±. Then TZm is an achievable rate region for the DMBC without 
common message. 

Gel'fand and Pinsker generalized Marton's model by considering DMBC with common information. 
The achievable rate region they proposed [20] is summarized below. 

Proposition 5: [20, Theorem 1] Let TZgp be the union of non-negative rate triples (Rq, R\, R 2 ) 
satisfying 

R < min[/(C/;y 1 ),/([/;y 2 )] (22) 

Ri + Ro < IiV^Y^+xnmiliU-Y^JiU-Y^) (23) 

R2 + Rv < /(V2;y 2 |tf) + mM[J(tf;yi),I(l7;y 2 )] (24) 

R l +R 2 + R < min[J(C/;y 1 ),7(C/;y 2 )]+7(y i; y 1 |C/) + /(y 2 ;y 2 |C/)-7(y 1 ;y 2 |C/) (25) 

for some (U, Vi, V 2 , X, Yi,Y 2 ) G Q 1 . Then TZgp i s an achievable rate region for the DMBC. 

We comment here that in the absence of common message, TZgp can be shown to be equivalent to 
TZm [20]. Furthermore, an equivalent definition of TZgp can be obtained by restricting Z £ Q 2 instead 
of Qi, i.e., 
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Lemma 2: Define 7Z' GP to be the union of non-negative rate triples (Rq, R\, R 2 ) satisfying (t22l>- (f25l) 
with Z £ Q 2 , then 

K GP = K' GP (26) 
The proof is similar to that for Lemma Q] and is skipped. Similarly, TZm can be equivalently defined 
using Z € Q 2 . 

An earlier outer bound by Korner and Marton [19, Theorem 5] for the capacity region of DMBC is 
subsumed by several recent outer bounds. One of the recent outer bounds was proposed by Liang and 



Kramer [22], [26, Theorem 6], as summarized in Proposition [6] 

Proposition 6: If (Rq, R\, R 2 ) is achievable, then there exists Z £ Q 1 and 

R < mm[I(U;Y 1 ),I(U;Y 2 )], (27) 

Ro + Ri < /(Vi,*7;lU (28) 

R0 + R2 < I(V 2 ,U;Y 2 ), (29) 

R + Ri+R 2 < I(X ] Y 2 \V 1 U) + I(V 1 ;Y 1 \U) + mm[I(U;Y 1 ),I(U;Y 2 )], (30) 

R + Ri+R 2 < I(X-Y l \V 2 U) + I(V 2 -Y 2 \U)+m.m[I(U-Y l ),I(U-Y 2 )). (31) 



We denote this outer bound as TZlk, i-£-> T^lk is the union of non-negative rate triples (Rq, R\, R 2 ) 
satisfying d27T>-<f3TT) over Z G Q\. Furthermore, we can also restrict the Markov chain condition to be 
Z G Q 2 , i.e., 

Lemma 3: Define TZ' LK to be the convex closure of union of non-negative rate triples (Rq, R\,R 2 ) 
satisfying (|27])-(l3l) with Z G Q 2 , then 

n LK = W LK (32) 
In [21, Theorem 2.1], another outer bound to the capacity region of the general DMBC was given by 

Nair and El Gamal, as summarized in Proposition |7] This outer bound was shown to be strictly tighter 

than the Korner and Marton outer bound [19, Theorem 5]. 

Proposition 7: If (Rq, R\, R 2 ) is achievable, then there exists Z G Q3 and 



Rq < min[/(C/;Fi),I(Z7;F2)], (33) 

tfo + ^i < /(Vil7;Yi), (34) 

#0 + ^2 < I(V 2 U;Y 2 ), (35) 

^0 + ^1+^2 < /(V r 2 ;F 2 |y 1 Z7)+J(Fii7;Fi), (36) 

Rq + R 1 +R 2 < 7(Fi;yi|F 2 C7) + /(V2C/;y 2 )- (37) 



We denote by IZne this new outer bound, i.e., IZne is the union of nen-negative rate triples (Rq, R\, R 2 ) 
satisfying (|33]>-(l37]> over Z G Q3. 

The most recent outer bound to the capacity region for DMBC was proposed by Liang, Kramer, and 
Shamai (Shitz) [23]: 
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Proposition 8: If (Rq, R x , R 2 ) is achievable, then there exist random variables (Wo, W x , W 2 , V x , V2, X, Y x , Y 2 ) 
whose joint distribution factors as 

p(w )p(w 1 )p(w 2 )p(v 1 ,V2\wo,w 1 ,W2)p(x\v 1 ,V2,wo,w 1 ,W2)p(yi,y2\x) (38) 

such that, 








< 


R < min[/(W ;yi|Fi), I(W ;Y 2 \V 2 )} 


(39) 




Ri 


< 


I(W X ;Y X \V X ) 


(40) 




R2 


< 


I(W 2 ;Y 2 \V 2 ) 


(41) 


Ro 


+ Ri 


< 


min[/(Wo^i; Y x \V X ), I(W X ; Y x \W V X V 2 ) + I(W V X ;Y 2 \V 2 )} 


(42) 


Ro 


+ R2 


< 


mm[I(W W 2 ;Y 2 \V 2 ), I(W 2 ;Y 2 \WoV x V 2 ) + I(W V 2 ; Y X \V X )] 


(43) 


Ro + i?i 


+ R2 


< 


I(W X ; Y x \W W 2 V X V 2 ) + I(W W 2 V x ;Y 2 \V 2 ) 


(44) 


R0 + R1 


+ R2 


< 


I(W 2 ;Y 2 \W W X V X V 2 ) + I(W W 1 V 2 ;Y 1 \V 1 ) 


(45) 


Ro + i?i 


+ R2 


< 


I{W x ;Y x \WoW 2 V x V 2 ) +I(W 2 ;Y 2 \ W V X V 2 ) + I(W V X V 2 ; Y x ) 


(46) 


Rq + Ri 


+ R2 


< 


I(W 2 ;Y 2 \W W X V X V 2 ) +I(W 1 ;Y X \W Q V 1 V 2 ) + I(W V X V 2 ;Y 2 ), 


(47) 



where X is a deterministic function of (Wo, W x , W 2 , V x , V 2 ), and Wo, W x , W 2 are uniformly distributed. 
We refer to this new outer bound as TZlks- 

III. An Achievable Rate Equivocation Region 

Our proposed achievable rate equivocation region for DMBC-2CM is given in Theorem Q] The coding 
scheme combines binning, superposition coding, and rate splitting. For the rate constraints, the binning 
approach in [28] is supplemented with superposition coding to accommodate the common message. An 
additional binning is introduced for confidentiality of private messages. We note that this double binning 
technique has been used by various authors for communication involving confidential messages (see, e.g., 
[18], [29]). 

Different from that of [18], we make explicit use of rate splitting for the two private messages in order to 
boost the rates i?i and R 2 . We note that this rate splitting was implicitly used in [4] (specifically, proof of 
Lemma 3 in [4]). To be precise, we split the private message W x <G {1, 2 nRl } into W xx £ {1, 2 nRl1 } 
and W xo G {l,---,2 nRl0 }, and W 2 e {1, • • 2 ni?2 } into W 22 G {1, • • •, 2 nR ™} and W 20 G {1, • • •, 2 nR ™}, 
respectively. W xx and W 22 are only to be decoded by intended receivers while W X q and W 2 q are to be 
decoded by both receivers. Notice that this rate splitting is typically used in interference channels to 
achieve a larger rate region as it enables interference cancellation at the receivers. It is clear that this rate 
splitting is prohibited if perfect secrecy is required as in [18]. Now, we combine (W X o, W 2 o, Wo) together 
into a single auxiliary variable U. The messages W xx and W 22 are represented by auxiliary variables V x 
and V 2 respectively. 



May 28, 2008 



DRAFT 



9 



The achievable rate equivocation for a DMBC-2CM is formally stated below. 

Theorem 1: Let IZj be the union of all non-negative rate quintuple (R\, R 2 , Rq, R e \, R e2 ) satisfying 

Rel < Rl (48) 
Re2 < R2 (49) 

R < min[/(C/;y 1 ),/(C/;y 2 )] (50) 

R1 + R0 < /(Fi;yi|C/)+min[/([/;yi),/(C/ ; y 2 )] (51) 

R 2 + R < I^YiW+mmlliU^JiU^)} (52) 

R 1 +R 2 + R < I{V 1 ;Y 1 \U) + I(V 2 )Y 2 \U)-I{V 1 -V 2 \U) + mm[I{U ] Y 1 ),I{U ] Y 2 )] (53) 

Rei < Iiyx-.Y^U) - I{V X \Y 2 V 2 \U) (54) 

Re2 < I(V 2 ;Y 2 \U) - IiV^Y^U) (55) 

over all (U, Vi, V 2 ,X, Y 1 ,Y 2 ) G Q 2 . Then Ki is an achievable rate region for the DMBC-2CM. 

Proof: See Appendix J] ■ 
Remark 1: The region IZi remains the same if we replace Q 2 with Q\. Formally, 
Proposition 9: Define TZ'j to be the union of all non-negative rate quintuple (Ri, R 2 , Rq, R e \, R e2 ) 

satisfying (|48]>-([55]> over Z G Qi, then 

TZ^Wj (56) 
Proof: The fact that IZj C TZ'j follows trivially from Q 2 C Q 1 . 
We now show TZ'j C TZj. Assume R 2 ,Rq, R e \,R e2 ) G 7£j, i.e., there exists ([/, Vi, V 2 ,X, Y\, Y 2 ) G 
Qi such that R 2 , Rq, R e i, R e2 ) satisfies (|48T)- (|551) . The proof is completed by definining U' = U, 
V( = UVi, and = UV 2 and observe that the same (R l} R 2 , R , R el , R e2 ) satisfies (I48l)-(l55l) for 
(U', V{, V 2 , X,Yi,Y 2 ) G Q 2 . M 
This achievable rate equivocation region unifies many existing results which we enumerate below. 

A. Csiszdr and Korner's region 

In [4], Csiszar and Korner characterized the rate equivocation region for broadcast channels with a 
single confidential message and a common message. 

By setting R 2 = and R e2 = in Theorem [Q it is easy to see TZi reduces to Csiszar and Korner's 
capacity region TZck described in Proposition [TJ 

B. Liu et al's region 

In [18], Liu et al proposed an achievable rate region for broadcast channel with confidential messages 
where there are two private message and no common message. In addition, the private messages are to 
be perfectly protected from the unintended receivers. 

By setting R\ = R e \, R 2 = R e2 and Rq = in Theorem [T] one can easily check that 7Zr reduces to 
Liu et al's achievable rate region Rlmsy-I described in Proposition |2] 
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C. Gel y and and Pinsker's region 

In [20], Gel'fand and Pinkser generalized Marton's result by proposing an achievable rate region for 
broadcast channels with common message. If we remove the secrecy constraints in our model by setting 
R e i = and i? e2 = in Theorem [T] we obtain an achievable rate region for the general DMBC, denoted 
by it, with the exact expressions in d22l-(l25T) with U — » (Vi, V2) — > X — > (yi,y 2 ). From Proposition [5] 
and Lemma 12 1Z = IZgp- 

Remark 2: The proofs in [19], [20] both use a corner point approach. A binning approach was used 
in [28] to prove a weakened version of [19, Theorem 2]. The proof introduced in the present paper, 
by stripping out all confidentiality constraints, provides a new way to prove the general achievable rate 
region of DMBC [20, Theorem 1] [19, Theorem 2] along the line of [28]. 

IV. Outer bounds 

Define TZoi to be the union, over all Z € Qi, of non-negative rate quintuple (Rq, Rx, i? 2 , R e \, i? e2 ) 
satisfying 

Rei < Ri (57) 

Re2 < R2 (58) 

Ro < min^C/jy!),/^;^)] (59) 

R0 + R1 < /(yi;yi|?7) + min[/(C/;y 1 ),/(?7;y 2 )] (60) 

^0 + ^2 < I(y 2 ;y 2 |f/) + min[/(C/;y 1 ),/([/;y 2 )] (61) 

R + R 1 +R 2 < I(V2;Y2\V 1 U) + I(V 1 ;Y 1 \U)+mm[I(U;Y 1 ),I(U;Y 2 )} (62) 

#0 + ^1+^2 < /(yi;yi|y 2 C/) + /(y2;y 2 |f/)+min[/(C/;y 1 ),/([/;y 2 )] (63) 

R el < mmt/^^y!^)-/^;^^),/^;^!^)-/^;^!^)] (64) 

R e2 < mmil^^W-I^YilUjJ^-^lV^-I^Y^ViU)}. (65) 

Similarly, define TI02 and TZoz in exactly the same fashion except with Q\ replaced by Q 2 and Q3, 
respectively. We have 

Theorem 2: TZoi, and IZ03 are all outer bounds to the rate equivocation region of the DMBC- 

2CM. 

Proof: The proof that IZ02 and TZoi, are outer bounds is given in Appendix ITT] That TZoi is an 
outer bound follows directly from Proposition [10] ■ 
Proposition 10: 

n 03 C K01 = 7Zo2- (66) 
Proposition [10] can be established by simple algebra whose proof is skipped. While IZ03 subsumes both 
TZoi and IZ02, the latter expressions are often easier to use in establishing capacity results or comparing 
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with existing bounds. For example, it is straightforward to show that IZ02 is tight for Csiszar and Korner's 
model [4], i.e., DMBC with only one confidential message. 
Below, we discuss various implications of Theorem |2 

A. The rate equivocation region of less noisy DMBC-2CM 

For the DMBC defined in Section III-Al channel 1 is said to be less noisy than channel 2 [30] if for 
every V -> X -> Y X Y 2 , 

/(V;yi)>/(^;y 2 ). (67) 
Furthermore, for every U — > V — ► X — ► Y\Y 2 , the above less noisy condition also implies 

I(V;Yi\U)>Ky;Y 2 \U). (68) 

Using Theorems Q] and |2j we can establish the rate equivocation region for less noisy DMBC-2CM as 
in Theorem [3] 

Theorem 3: If channel 1 is less noisy than channel 2, then the rate equivocation region for this less 
noisy DMBC-2CM is the set of all non-negative (Rq, R\, R 2 , R e i, Re2) satisfying 

Rei < Ri (69) 

R0 + R2 < I(U;Y 2 ) (70) 

#0 + ^1 + ^2 < I(V;Y 1 \U) + I(U;Y 2 ) (71) 

Rei < HV-^U) - I(V;Y 2 \U) (72) 

Re2 = 0, (73) 

for some (U, V, X, Yi,Y 2 ) such that U -» V -» X -» Fiy 2 . 

Proof: The achievability is established by setting V 2 = const in Theorem Q] and using Eqs. (I67T ) 
and (I68T ). To prove the converse, we need to show that for any rate quintuple satisfying Eqs. (|57T)-(|65T) 
in Theorem El we can find (U', V, X, Y u Y 2 ) such that U' -» V -> X -» Yir 2 and are 
satisfied. This can be accomplished using simple algebra and by defining U' = UV 2 and V = V\ where 
(U, Vi, V 2 ,X, Yi, Y 2 ) € Q2 are the variables used in Theorem [2] ■ 
Remark 3: The fact that R e2 = is a direct consequence of the less noisy assumption: receiver 1 can 
always decode anything that receiver 2 can decode. 

B. The rate equivocation region of semi-deterministic DMBC-2CM 

Theorem [2] also allows us to establish the rate equivocation region of the semi-deterministic DMBC- 
2CM. WLOG, let channel 1 be deterministic. 



May 28, 2008 



DRAFT 



12 



Theorem 4: If p(yi\x) is a (0,1) matrix, then the rate equivocation region for this DMBC-2CM, 
denoted by 1Z sc i, is the set of all non-negative (Rq, Ri, R 2 , R e i, R e2 ) satisfying 

Rei < Ri (74) 

Re2 < R2 (75) 

R < min[/(C/ ; ri) ! J(C7;y 2 )] (76) 

R0 + R1 < H(Y 1 \U) + mm[I(U;Y 1 ),I(U;Y 2 )] (77) 

R0 + R2 < I(V 2 ;Y 2 \U)+mm[I(U;Y 1 ),I(U;Y 2 )} (78) 

R + R! + R 2 < H(Y 1 \V 2 U) + I(V 2 ;Y 2 \U) + mm[I(U;Y 1 ),I(U;Y 2 )} (79) 

Rei < H(Y 1 \Y 2 V 2 U) (80) 

# e2 < I(V 2 ;Y 2 \U) - I(V 2 ;Y±\U), (81) 

for some (U, Y u V 2 , X, Y u Y 2 ) G Q 2 . 

Proof: The direct part of this theorem follows trivially from Theorem Q] by setting V\ =Y\. 
The proof is therefore complete by showing 1Zsd-02 Q T^sd, where 1Zsd-02 is the outer bound H-02 
specializing to the semi-deterministic DMBC-2CM. That is, for any Z € Q 2 and (Rq, R\, R 2 , R e \, R e2 ) 
satisfying d57l)-d65l), we need to show that (Rq, Ri, R 2 , R e \, R e2 ) also satisfies (|74"l)-(|8lT). We note that 
Eqs. (I74l-(|76"1). d78l) . and (I8TI ) can be trivially established. That the sum-rate bound Eq. (1771 ) is satisfied 
follows easily from the fact 

H(Y 1 \U)>I(V 1 ;Y 1 \U). (82) 



The sum-rate bound for Rq + Ri + R 2 in Eq. d62l and d63l ) can be re-written as 

r + r 1 + r 2 < nun[j(y 2; y 2 |^itr)+/(v 1 ;y 1 |tr),j(Vi;y 1 |W)+i(v 2 ;y 2 |^)] (83) 

+ min[/(C/ ; y 1 ),/(C/;y 2 )]. (84) 

Thus d79l ) is satisfied since 

H(Y 1 \V 2 ,U) + I(V 2 ;Y 2 \U)>I(V 1 ;Y 1 \V 2 U) + I(V 2 ;Y 2 \U). (85) 
For Eq. ( f80b . we only need to show (cf. d64l ) 

i/(yi|y 2 y 2 c/) > /(y^yiiw) - i(Vv,y 2 \v 2 u). (86) 

We have 

#(yi|y 2 y 2 tO > i^y^y^u) (87) 

= HVv^Y^U) - I(V i; Y 2 \V 2 U) (88) 

> /(yi;yi|y 2 c/)-/(Vi;y 2 |y 2 c/). (89) 
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The proof of Theorem [4] is therefore complete. ■ 
Similarly, the rate equivocation region of deterministic DMBC-2CM can be established as follows. 
Proposition 11: If p(y\\x) and p(y 2 \x) are both (0, 1) matrices, then the rate equivocation region for 

this deterministic DMBC-2CM is the set of all (Rq, Ri, R 2 , R e i, Re?) satisfying 

(90) 
(91) 
(92) 
(93) 
(94) 
(95) 
(96) 
(97) 








< 


Rel < R\ 







< 


Rel < Ri 







< 


Ro <min[/(C7;yi),/(C/ ; y 2 )] 




Rq + R\ 


< 


H(Yx\U) + min[/(C7; Y x ), I(U; Y 2 )} 




Rq + R2 


< 


I{Y 2 \U) + ^m[I{U-,Y l ),I{U-Y 2 )] 


Ro - 


f Ri + R 2 


< 


H(Y 1 Y 2 \U)+mm[I(U;Y 1 ),I(U;Y 2 




Rel 


< 






Re2 


< 


H(Y 2 \YxU), 


for some (U,Y U Y 2 , X,Y 1 . 


Y 2 ) G Q 2 . 







C. Outer bound for DMBC-2CM with perfect secrecy 

By setting Rq = 0, R e \ = R\ and R e2 = R 2 in Theorem [2l we obtain outer bounds for DMBC-2CM 
with perfect secrecy, denoted respectively by IZps-oi, 7tps-02, and TZps-os f° r Z G Qi, Z G Q2, 
and Z G Q 3 . Clearly, 

T^PS-ox = ftps-02 2 TZps-o3 (98) 
In addition, from Proposition [3j we have 

Ttps-02 = TIlmsy-o- (99) 

i.e., lZps-02 coincides with Liu a/'s outer bound in Proposition [3] Finally, all these outer bounds are 
tight for the semi-deterministic DMBC-2CM with perfect secrecy. 

D. New outer bounds for the general DMBC 

Specializing Theorem [2] to the general DMBC, i.e, setting R e \ = R e2 = 0, we obtain the following 
outer bounds for the general DMBC. 
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Theorem 5: For any Z € Q\, let Sbc{Z) be the set of all (i?o, R±, R 2 ) of non-negative numbers 
satisfying 

R < min[/(i7;Fi),J(C/;y 2 )] (100) 

R0 + R1 < I(V l] Y l \U)+m\n[I(U;Y l ) 1 I(U-Y 2 )) (101) 

#0 + ^2 < I(V 2 ;Y 2 \U)+m\n[I(U;Y l ) 1 I{lJ-Y 2 )\ (102) 

#0 + ^1 + ^2 < /(y 2 ;y 2 |yiC/) + /(y i; y 1 |C/)+min[/([/;y 1 ),/([/;y 2 )] (103) 

^0 + ^1 + ^2 < /(yi;yi|F2t/)+/(y 2 ;y2|^)+min[/(C/;y 1 ),/([/;y 2 )]. (104) 

Then 

n BC -oi= |J Sbc(Z) (105) 

constitutes an outer bound to the capacity region for the DMBC. 

One can establish in a similar fashion two other outer bounds for the general DMBC, denoted 
by TIbc-02 and 1Zbc-OZ> by replacing Q\ in Theorem [5j with Q 2 and Q3, respectively. Similar to 
Proposition [TUJ we have 

Ti-BC-Oi ^ Hbc-oi = 7Lbc~02- (106) 

Remark 4: It is interesting to observe that the inequalities of our outer bound IZbc af e ah identical to 
those of the existing inner bound [20], described in Proposition [51 except for the bound on i?o + R\ + R 2 , 
for which there is a gap of 

7 = mm[I(V 1 ;V 2 \Y 1 ,U),I(V 1 ;V 2 \Y 2 ,U)}. (107) 
Remark 5: It is easy to show that IZbc -02 subsumes the outer bound in [22, Theorem 6] since 

IiVx-Y^U) < IiX-Y^U), (108) 
I(V 2 \Y 2 \V X U) < I(X-Y 2 \V X U). (109) 

Remark 6: The new outer bound TZbc-OZ is al so a subset of the outer bound proposed in [21, Theorem 
2.1], as described in Proposition [7] More precisely, we have 

Proposition 12: 1Zbc-03 ^ T^ne, where the equality holds when 1) Rq = 0; or 2) R\ = 0; or 3) 
R 2 = 0. 

Proof: See Appendix UTTl ■ 
Remark 7: Note that the conditions in Proposition [T2l are only sufficient conditions, i.e., there may be 
other instances when the two bounds are equivalent. It is also possible that 1Zbc-OS = Une though we 
have not been successful in proving (or disapproving) it. 
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Remark 8: One can easily verify that the outer bound proposed in [23], IZlks in Proposition [U 
subsumes all the above outer bounds. To summarize, we have 



It remains unknown if any of the above the subset relations can be strict or not. 

The fact that IZlks subsumes existing outer bounds can be attributed to the way auxiliary random 
variables are defined in [23]. By further splitting auxiliary random variables and isolating those corre- 
sponding to the message variables, one can keep the terms in the rate upper bounds which are otherwise 
dropped if only three auxiliary variables are used as in Theorem |2] or [21]. Finally, we remark that the 
approach in [23] can be adopted to the problem involving secrecy constraint in a straightforward manner 
to obtain a new outer bound to the rate equivocation region for DMBC-2CM. 



We proposed inner and outer bounds for the rate equivocation region of discrete memoryless broadcast 
channels with two confidential messages (DMBC-2CM). The proposed inner bound combines superpo- 
sition, rate splitting, and double binning and unifies existing known results for broadcast channels with 
or without confidential messages. These include Csiszar and Korner's capacity rate region for broadcast 
channel with single private message [4], Liu et a/'s rate region for broadcast channel with perfect secrecy 
[18], Marton and Gel'fand-Pinsker's achievable rate region for general broadcast channels [19], [20]. The 
proposed outer bounds also generalize several existing results. In addition, the proposed inner and outer 
bounds settle the rate equivocation region of less noisy, deterministic, and semi-deterministic DMBC- 
2CM. In the absence of the equivocation constraints, the proposed outer bounds reduce to outer bounds for 
the general broadcast channel. General subset relations with other known outer bounds were established. 
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Appendix I 
Proof for Theorem Q] 

We prove that if (Rq, R\, R 2 , R e x, R e 2) is achievable, then it must satisfy Eqs. (|481)-(|55T) in Theorem 
Q] for some (U, V%, V 2 , X, Y\, Y 2 ) € Q 2 . We first prove the case when 




(110) 



V. CONCLUSION 



Rx > ReX = I{V 1 ;Y 1 \U)-I{V 1 ;Y 2 V 2 \U)>0, 



(111) 



R2 > R e2 = I{V 2 ;Y 2 \U)-I{V 2 ;Y 1 V 1 \U)>0. 



(112) 
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Rate splitting, as described in Section JII] gives rise to the following five message variables: 





G 


{1,2,- 


, , 2 nK o | 


w w 


g 


{1,2, ■ 


2 n ^io | 




G 


{1,2,- 


2 nR n | 




G 


{1,2,- 




W22 


G 


{1,2,- 


2™^22 1 



where i?io + R\\ = R\ and i? 2 o + R22 = ^2- We remark here that (II 1 II) and (II 121 ) combined with the 
rate splitting and the fact that W\q and W20 are decoded by both receivers ensures that, 

Rn > Rei = I(V 1 ;Y 1 \U)-I(V 1 ;Y 2 V 2 \U)>0, (113) 

R22 > R e 2 = I(V 2 ;Y 2 \U)-I(V 2 ;Y 1 V 1 \U)>0. (114) 

Auxiliary Codebook Generation: Fix p{u), p(v\\u), p(v 2 \u) and p(x\vi,v 2 )- For arbitrary e\ > 0, 
Define 



Note that 



£11 


= /(yi;yi|c/)-/(y i; y 2 y 2 |c/), 


(115) 


£12 


= /(Vi;y 2 |W, 


(116) 


£21 


= /(v^ltO-zO^nW), 


(117) 


-^22 


= J(y 2 ;*i|Vii7), 


(118) 


£3 


= I(Vr,V 2 \U) - e 1 . 


(119) 


ill 


+ L 12 + L 3 = I(V X -Y X \U) - e x , 


(120) 


£21 


+ L 22 + L 3 = I{V 2] Y 2 \U) - et. 


(121) 



• Generate 2 n ( Rl0+R20+R °^ independent and identically distributed (i.i.d.) codewords u(A;), with k G 
{1, • • • , 2 n( ~ Rlo+R20+Ro ^}, according to \~\t =1 p{u t ). 

• For each codeword u(fc), generate 2 n ^ Lll+Ll2+L ^ i.i.d. codewords vi(i,i',i"), with i G {1, • • • , 2 nLl1 }, 
i! G {1, • • • ,2 nLl2 } and i" G {1, • • • ,2 nL3 }, according to Y\t=iP( v u\ u t)- Tne indexing allows an 
alternative interpretation using binning. We randomly place the generated vi vectors into 2 nLl1 bins 
indexed by i; for the codewords in each bin, randomly place them into 2 nLl2 sub-bins indexed by 
i'\ thus i" is the index for the codeword in each sub-bin. 

• Similarly, for each codeword u, generate 2 n<yIj21+L22+L ^ i.i.d. codewords v 2 (j, f , j") according to 
Ut=i P(v2t\u t ), where j G {1, • • • , 2 nL ^}, f G {1, • • • , 2 nL22 } and /' G {1, • • • , 2 nL *}. 

Encoding: Encoding involves the mapping of message indices to channel input, which is facilitated 
by the auxiliary codewords generated above. 
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To send message (ioio, W20, wq), we first calculate the corresponding message index k and choose 
the corresponding codeword u(k). Given this u(k), we have 2™( Lll+Ll2+L3 ) codewords of vi(i,i',i") to 
choose from for message w\\. Evenly map 2 nRl1 messages w\\ to 2 nLl1 bins, then, given (11131 ), each 
bin corresponds to at least one message w\\. Thus, given w\\, the bin index i can be decided. 

1) If Rn < Ln + L 12 , each bin corresponds to 2 Rll ~ Ll1 messages wn. Evenly place the 2 nLl2 
sub-bins into 2 Rll ~ Ll1 cells. Given wn, we can find the corresponding cell, and randomly choose 
a sub-bin from that cell, thus the sub-bin index i' can be decided. The codeword Vi(i, will 
be chosen from that sub-bin. 

2) If L\\ + L\2 < Rn < Ln + L\2 + L3, then each sub-bin is mapped to at least one message W\\, 
so %' is decided given w\\. In each sub-bin, there are 2 Rll ~ Lll ~ Ll2 messages. Evenly place those 
2 nL3 codewords vj into 2 Rll ~ Lll ~ Ll2 cells. Given wn, we can find the corresponding cell. The 
codeword Vi(i, will be chosen from that cell. 

Given W22, the selection of Vj j> j>> is carried in exactly the same manner. From the given sub-bins or 
cells, the encoder chooses the codeword pair (vi(i,i',i"), V2(j, that satisfies 

(v 1 (i,i',i"),v 2 U,j',j"),u(k)) G Ai n \v u V 2 ,U), (122) 

where A^J l \-) denotes the jointly typical set. If there are more than one such pair, randomly choose one; 
if there is no such pair, an error is declared. 

Givenvi and v 2 , we generate the channel input x according to i.i.d. p(x\v\, V2), i.e., x ~ Yli=i P( x i\ v ^'^ v 2i) 
where vu and V2i are respectively the ith element of the vectors vj and V2. 

Decoding: Receiver Y± looks for u(fc) such that 

(u(fe),yi) G A^(U t Y!). (123) 

If such u(k) exists and is unique, set k = k; otherwise, declare an error. Upon decoding k, receiver Y\ 
looks for sequences vi(i,i',i") such that 

(vi(i,i',t"),u(A;),yi) e A^^U^). (124) 

If such vi(i,i',i") exists and is unique, set i = i, %' = %' and i" = i"; otherwise, declare an error. From 
the values of k, i, i' and i", the decoder can calculate the message index wq, Wiq and wn. The decoding 
for receiver Y% is symmetric. 

Analysis of Error Probability: We only consider P^f since can be analyzed symmetrically. 
WLOG, we assume the transmitted codeword indices are k = i = i' = i" = 1. If an error is declared, 
one or more of the following events occur. 

A\ : There is no pair (vi, V2) such that (|122l) holds. 

A 2 : u(l, 1) does not satisfy (1123b . 

A 3 : u(k, k') satisfies (fl23l . where (k, k') ^ (1, 1). (125) 

At : vi(l, 1, 1) does not satisfy (1124b . 

A 5 : vi(i,i',i") satisfies (|124b . where ^ (1,1,1). 
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The fact that Pr{A 2 } < e and Pr{A^} < e for sufficiently large n follows directly from the asymptotic 
equipartition property. We now examine error events A\, A%, A§. 
Let E(v\, v 2 , u) denote the event (1 1 22b - Then 

Pr{E(vi,v 2 ,u)} = ^2 p( u M v i| u M v 2|u) (126) 

(u,v 1 ,v 2 )eA < c 7l) 

> \A^\2- n ( H W +t h- n ( H ( Vl W +e h- n ( H ( V2 W +e *> (127) 

> 2- n ( H ( u )+ H( - Vl \ u )+ H ( V2 \ u )- H ( UVlV2 )+' ie ) (128) 

> 2 -n(/(y i; V 2 |C/)+4e) (129) 

So, 

Pr{^il < II (l--Pr{S(«i,^,«)}) (130) 

(vi,v 2 |fc) 

< JJ (1 - 2~ n(/(yi;V/2|c/)+4e) ) (131) 

(vi,v 3 |fc) 

From [28], [31], it is clear that if 

IiVuYLp) -ex- Ru + I(V 2 ;Y 2 \U) - e 2 - R 22 > I(V r , V 2 \U) (132) 

Pr{A{\ < e. 

For A^, we have, from the decoding rule, Pr{A%} < e if 

^0 + ^10 + ^20 <I{U\Y{). (133) 
For A 5 , we first note that for ^ (1, 1, 1), 

P{vi(*,i',*")> u (*)>yi) e 4 n) (^i>^^i)} < 2- n ( / ( yi;Yl l c/ )" 4e ) (134) 

Given that the total number of codewords for vj is Ln + L12 + L3 = /(Vj; Vi | f7) — e\, it is easy to 
show that if 

Rxi<I(V x ;Y x \U)-ex (135) 

then P{A$} < e for n sufficiently large. 
Since 

Pj? < Pr |U AA < J2 Pr{Ai}, (136) 



P e ( " } < 5e when (EJ, C3l and (El hold. 

e,2 

R + R w + R 20 < I(U;Y 2 ) (137) 
i? 22 < I(V 2 ;Y 2 \U)-ei (138) 

May 28, 2008 DRAFT 



Symmetrically, for pffi) < 5e as n is sufficiently large, we need d 132b . (11331 ) and 



19 



Apply Fourier-Motzkin elimination on (1 132b . (1133b . (1135b . (11371 ) and (1138b with the definition i?i = 
R u + i?i and R 2 = R22 + R20, we get (I50l)-(l53l). 

Equivocation: Now, we prove the bound on equivocation rate (l54l ). Eq. (l55l) follows by symmetry. 

ff(Wi|Y 2 ) > fl"(Wi|Y 2 ,V 2 ,U) (139) 

= fl-(Wii,Wio|Y2,V 2j U) (140) 

( = } H{W n \Y 2 ,V 2 ,V) (141) 

= tf(VFn,Y 2 |V 2 ,U)-i/(Y 2 |V 2 ,U) (142) 

= H(W U , Vi, Y 2 1 V 2 , U) - F(Y 2 |V 2 , U) - £T(Vi |Y 2 , V 2 , U, W u ) 

= fr(Wu > Vi|V2,u) + £r(Y 2 |Vi,v 2 ,u,Wii) 

-#(Y 2 |V 2 , U) - iJ(Vi|Y 2 , V 2j U, Wn) (143) 

® F(Vi|V 2 ,U)-I(Vi;Y 2 |V 2 ,U)-i7(V 1 |Y 2 ,V 2j U J W 1 i) 

= F(V a |U) - J(V i; V 2 |U) - J(Vi; Y 2 |V 2 , U) - F(V a |Y 2 , V 2 , U, W u ) (144) 

where (a) follows from the fact that given U, W\o is uniquely determined, and (b) follows from the fact 
that given Vi, Wn is uniquely determined. 

Consider the first term in (1144b . the codeword generation ensures that 

#(Vi|U) = l og 2 n(Lll+Ll2+L3) =nI(V 1 ;Y 1 \U)-ne 1 . (145) 

For the second and third terms in (1144b . using the same approach as that in [18, Lemma 3], we obtain 

/(V i; V 2 |U) < nI{V l] V 2 \U) + ne 2 (146) 

7(V i; Y 2 |V 2 ,U) < nI(Vi;Y 2 \V 2 U) + ne 3 (147) 

Now, we consider the last term of (1144b . We first prove that, given V 2 , U and Wn, the probability of 
error for Y 2 to decode Vi satisfies P e <e for n sufficiently large. Y 2 looks for vi such that 

(vi,v 2 ,u,y 2 ) e Ai n \v u V 2 ,U,Y 2 ). (148) 

Since Rn > Ln, and given the knowledge of Wn, the total number of possible codewords of vj is 

N\ < 2 n( - Ll2+L ^ = 2 n( - I( - Vl ' v ' 2Y ^ u ' , ~ tl \ (149) 
Now define E(vx,v 2 ,u,y 2 ) the event in (1148b . We have 

Pr{E(vi,v 2 ,u,y 2 )} = ^ p(u)p(vi|u)p(v 2 ,y 2 |u) (150) 

(u,vi,v 2 ,y 2 )eAr ) 

< |^(«)|2-™W c/ )- e )2- n ( H ( Vl l c/ )- e )2- n(H(y2y2|l/) - e) (151) 
<- 2 - ri (' H "( c/ )+ H ( y il C7 )+ H ( y 2^2|t / )-^(c/ViV' 2 y 2 )-4e) / 152 ) 

< 2- n ( I (Vi',V2Y a \U)-4e) ^53) 
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Now, the probability of error for Y2 to decode Vi is 

Pe < e + Nl . 2 -n(/(^;^|c/)-46) (154) 

< e + 2~ n ^-^ (155) 

< 2e (156) 

where the first e accounts for the error that the true Vi is not jointly typical with V2,U, Y2 while the 
second term accounts for the error when a different Vi is jointly typical with V2,U, Y2. By Fano's 
inequality [32], we get 

tf(Vi|Y 2 ,V 2 ,U,Wii) <ne' n . (157) 

Combine ( fl45l ), ( fT46l ( fTTTl ) and ( fl57l ), we have the bound ( f54b . 

The above proof is only for the case when (11111 ) and (11121 ) are satisfied. By using the same convexity 
argument as in Lemma 5 and Lemma 6 in [4], we can easily show that the region (l48l)- (l55l ) is also 
achievable. This completes the proof for Theorem [TJ 



Appendix II 
Proof of the outer bounds in Theorem [2] 

We only prove IZ02 and TZo3 w& outer bounds in this section. The proof of Theorem [2] is complete 
by the fact that IZ01 = ~R-02 (cf. Proposition [TOl). 

We first define the following notations/quantities. All vectors involved are assumed to be length n. 

X i = (X 1 ,---,X i ); (158) 

X 1 = (X h ---,X n ); (159) 

n 

S a = ^/(^ +1 ; y li |y i ^ 1 ^ ); (160) 

8=1 

n 

El = ^/(Yj-^yaii^wb); (161) 

i=l 

and (X^Xg), (Ss,!!^), CE^^l) are analogously defined by replacing Wq with WoWi> W0W2 and 
W0W1W2 in Eqs. dl60l ) and dl61| ), respectively. In exactly the same fashion as in [4, Lemma 7], one 
can establish, for a = 1, 2, 3, 4, 

S a = £*. (162) 

We begin by Fano's Lemma, 

H(W ,W 2 \Y 2 n ) < ne n . 
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where e n — > as n — > oo. Eqs. (1571 ) and (1581 ) follow trivially from 

< //(VFill^" - ) < H(Wi), 
< i?(V^ 2 |>T) < H(W 2 ). 

Next we check bound for Rq. 

nR = H(W ) = IiWo-Y^ + HiWo^) 

n 

i=l 
n 



= ^(/(WoF/- 1 ; Y u ) ~ /(F/- 1 ;^)) + ne„ 

i=l 
n 

< ^(7(WoF/- 1 F 2 i + 1 ;F 1 0-/(F 2 i+ S-F li |Fr 1 W- )) + n en 

i=l 
n 

= /(WqF/- 1 ^ 1 ; y u ) - Ex + ne n 

i=l 
n 

< I(W Yt 1 Yi+ 1 ;Y li ) + ne n 



i=l 



Similarly, 



nR < ^IiWoYt^+^^-El + nen 

i=l 
n 

< KWoYt 1 ^ 1 ; Y 2i ) + ne n 



i=i 



Therefore 



uRq < min 



Y /(WqF/- 1 ^ 1 ; Y U ), Y I{W Yt l Yi+ l - Y 2t ) 



i=l 



i=l 



+ rae n . 



Consider the sum rate bound for Rq + R\. 

n(R + R 1 ) = H(W ,Wi) = H (W ) + H (W^Wq) 

= H(W ) + I(Wr, Y?\W Q ) + H{W X \Y?W Q ) 

< H(Wo)+I(W 1 ;Y 1 n \W ) + ne n 



(163) 
(164) 



(165) 

(166) 

(167) 

(168) 

(169) 
(170) 

(171) 
(172) 

(173) 

(174) 
(175) 
(176) 
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Consider the sum rate bound for Rq + Ri + R 2 . 

n(R + R 1 + R 2 ) = H(W ,Wi) + H(W 2 \W 1 W ) (188) 

= H(W ,Wi) + I(W 2 ;Y 2 n \W 1 ,W ) + H(W 2 \Y 2 n W W 1 ) (189) 

< HiW^W^+IiW^Y^WuW^+nen, (190) 
n{R a + R l + R 2 ) = H(W ,W 2 ) + H(W 1 \W 2 W ) (191) 

= H(W ,W 2 )+I(W 1 ;Y{ l \W 2 ,Wo)+H(W 1 \Y^W W 2 ) (192) 

< ff(Wo,W 2 )+/(Wi;y 1 n |W 2 ,Wo)+ne n . (193) 
Following similar procedure as in (I178l )- (11811 ). we can obtain 

n 

I(W 2 ;Y?\W U W Q ) = ^I(W 2 ]Y 2i \Y*- 1 Y* 1 W W 1 ) + Et-T;i (194) 



IiWuYftW^Wo) = ^/(^i;yi i |y i i - 1 y 2 i+1 ^o^2) + S 3 -S4, (195) 



1=1 



Combine (fl84l ), (fT90l . (fl94l . and (fT62l . we get 



n(i? + -Rl + #2) < min 



2 IiWoYt 1 ^ 1 ;Y U ),J2 IiWoYt 1 ?^ 1 ; y 2l ) 

.i=l i=l 



+ HW^YulY^Y^Wo) + HW 2 ; Y^Y^Y^W^) + 3ne,(196) 
i=i i=i 

Alternatively, combining (11861 ). (11931 ), ( 11951 ), and (11621) yields 



n(R + i?i + R 2 ) < min 



£ /(Wbl? -1 ^ 1 ; Y U ), moYt l n +l ; Y2i) 

i=l i=l 

rt 



+ Y T ( W ^ ^l^r 1 ^ 1 ^) + ^ /(Wi; ywl^-^VoWa) + 3ne^l97) 
i=l i=l 

We now consider the equivocation rate bound. 

i?ei < tfW|Y 2 n ) (198) 

= fl-(Wi|I?Wb) + /(^i;W |y 2 n ) (199) 

< H(W 1 \W )-I(W 1 ;Y 2 n \W ) + H(W \Y 2 n ) (200) 
= I(Wi;Y?\W ) - /(^i;y 2 n |iy ) + H(W 1 \Y{ l W ) + H(W \Y 2 n ) (201) 

< I(W 1 ;Y{ l \W )-I(W 1 ;Y 2 n \W ) + 2ne n , (202) 
Rei < H(W\\Y 2 ) (203) 

= HiW^YfWoW^ + IiW^WoW^Y?) (204) 

< i?(Wi|WoW 2 ) - /(Wi; yriWoWa) + ^WoWa^) (205) 
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= I(Wi; Y?\W W 2 ) - I(Wi; Y?\W W 2 ) + H(W 1 \YfW W 2 ) + H(W W 2 \Y 2 n ) (206) 
< I(W 1 ;YT\WoW 2 ) - I(Wi; Y?\W W 2 ) + 2ne n .. (207) 

Of the terms involved in (12021 and (12071 only I(Wi;Y£\Wq) and I(W 1 ;Y 2 n \W W 2 ) have yet to be 
determined. Similar to (11781 )- (11811 ). we can get 



/(Wi;iy|W ) = Y t I(Wr,Y 2i \Yi- 1 Y^+ 1 W ) + ^* 1 -J:* 2 , (208) 
1=1 

n 

/(v^yfiww^ = ^/(w i; y 2i |y 1 ^ 1 y 2 m iy w 2 ) + ^-s:. (209) 



1=1 

Therefore we get 



Rei < ^ J ( W i; y iil y / -1 ^2 +1 Wo) -^I(W 1 ;Y 2i \Yf- 1 Yt 1 W )+2ne n , (210) 



i=l i=l 
n n 



Rei < ^/(tyi;yidyr 1 y 2 i+1 WoW2)-^/(tyi;y 2i |yr 1 y 2 +1 Wo^ 2 ) + 2ne„. (211) 

8=1 8=1 

Bounds on i? e2 are analogously obtained: 



Re2 < T ^ Y2i\Yt l Y 2 i+1 W ) - I(W 2 ; YulY^Y^Wo) + 2ne n , (212) 
i=l i=l 
n n 

« e2 < ^ /(W 2 ; yal^^WbWi) - HW 2 ; Y li \Yt 1 Y^ 1 W Q W l ) + 2ne„. (213) 

i=i i=i 

Let us introduce a random variable J, independent of WoW\W 2 X n Y{ l Y2 , uniformly distributed over 
{1, ■■■ ,n}. Set 

U = WaY/^f/^J, Vi = WiU, V 2 = W 2 U, 

x ± Xj, Y x 4 y lj5 y 2 = y 2J . 

Substituting these definitions into Eqs. (1173b . (II 85b . (1187b . dl96[ dl97b . and d210b - d213b . we obtain, 
through standard information theoretic argument, the desired bounds as in Eqs. (I57l)-(|65T). The memoryless 
property of the channel guarantees U ^ ViV 2 —>■ X —> Y X Y 2 . This completes the proof. 

To prove IZ03 is also an outer bound, we follow exactly the same procedure except that auxiliary 
random variables are defined differently. Specifically, 

U = WqY^Y^J, Vi=W u V 2 = W 2 . 

Appendix III 
Proof of Proposition [T2l 

By simple algebra, one can show TIbc-os Q The fact that TZbc-OZ = TZ-ne when Rq = 

can also be verified by direct substitution. 
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We now prove the equivalence under R 2 = 0, and the case for R\ = can be established by index 
swapping. With R 2 = 0, Eqs. (1100l) - (1104b of 1Zbc-OZ can be easily shown to be equivalent to 

R < nun[J(E7;Yi),I(tr ; y 2 )], (214) 
R0 + R1 < I(yi;yi|f/) + min[/(f/;y 1 ),/(C/;y 2 )], (215) 

We note this is precisely the capacity region for DMBC with degraded message set [4, Corollary 5]. 
With R 2 = 0, TZne in Proposition [7] reduces to 

R < min[/(*7;Yi),J([/;Y 2 )], (216) 
R0 + R1 < I{V X U;Y X ), (217) 
R + Ri < IiVv^^U) + I(UV 2 ;Y 2 ). (218) 

Apparently 1Zbc-OZ Q TZne, and it remains to check TZne Q TZbc-03- Assume (i?o,-Ri) G TZne 
and (U, V±, V 2 ,X, Yi, Y 2 ) £ Q3 are the variables such that Eqs. (1216l) - (1218b are satisfied. Consider three 
cases for analysis. 

1) 1(17; Yi) < I(U;Y 2 ). The proof of (R ,Ri) £ 7l B c-03 is trivial. 

2) I{U-Y X )>I(U-Y 2 ) and I^U^) > I(V 2 ,U;Y 2 ). 
Define V{ = V u U' = UV 2 . From (l216ll . 

R < min[7(C/;y 1 ),7(C/ ; y 2 )] (219) 

< min[/(c/y 2; y 1 ),j([/y 2 ;y 2 )] (220) 

= min[7(C/ / ;y 1 ),7(C/ , ; y 2 )] (221) 

From (12181 ). 

R0 + R1 < IiVt-Y^UV^ + I{UV 2 -Y 2 ) (222) 

= 7(y 1 / ;y 1 |[/')+7(*7 , ;y 2 ) (223) 

Thus (Rq, R 2 ) also satisfies (12141) and (12151) for U'V{ -» X yy 2 . 

3) 7([/ ; y) >7([/ ; y 2 ) and/(y 2 ,?7;y 1 ) <7(y 2 ,?7;y 2 ). 

For this case, we can always find a function g(-) such that 

7(C/ 5 (y 2 ); y) = I(Ug(V 2 ); Y 2 ). (224) 
Define V{ = V\,U' = Ug(V 2 ) and we can verify that (R ,Ri) satisfies (12141) and (12151 ) for 

u'v( ^x^ yy. 

The above argument completes the proof of Proposition [12] 
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